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1.  Introduction 


The  System  of  Systems  Survivability  Simulation  (S4)  is  designed  to  be  used  by 
analysts  of  the  US  Anny  Research  Laboratory’s  (ARL’s)  Survivability/Lethality 
Analysis  Directorate  (SLAD)  to  investigate  survivability,  lethality,  and 
vulnerability  (SLV)  issues  in  a  mission  context  containing  multiple  systems.  SLAD 
and  the  Physical  Science  Laboratory  (PSL)  of  New  Mexico  State  University 
(NMSU)  are  working  together  to  develop  S4.  A  general  S4  usage  description  has 
been  previously  published  by  SLAD. 1  Three  key  areas  of  SLAD’s  SLV  mission  are 
supported  by  S4:  Electronic  Warfare  (including  communications  systems), 
Infonnation  Operations/Information  Warfare,  and  Ballistics. 

As  part  of  the  SLV  mission  involving  communications  systems,  SLAD  assesses 
various  potential  vulnerabilities  in  radios  and  radio  networks  through  laboratory 
and  field  investigations,  and  explores  the  resulting  survivability  impacts  of  these 
vulnerabilities  in  a  System  of  Systems  mission  context  using  modeling  and 
simulation.  The  findings  of  these  investigations  infonn  Anny  decision  makers,  the 
Anny’s  independent  evaluator,  and  materiel  developers. 

The  Sage  model,  part  of  the  S4  simulation  suite,  has  been  developed  primarily  to 
support  SLAD  analysts  in  pretest  planning  and  quick  turnaround  analyses  of 
Electronic  Warfare/Communications  events  during  field  tests.  For  the  verified  and 
validated  usage  described  in  this  report,  Sage  is  configured  to  run  on  an  analyst’s 
personal  computer  during  a  field  test  or  laboratory  investigation. 

The  Joint  Tactical  Radio  System  (JTRS),  a  software-defined  family  of  radios,  is 
planned  to  be  the  next-generation  voice-and-data  radio  used  by  the  US  Military. 
Several  features  of  the  JTRS  Rifleman  Radio  (RR)  and  Manpack  radio  are 
implemented  in  Sage  2.0;  however,  it  should  be  stressed  that  this  Verification  and 
Validation  (V&V)  activity  is  focused  on  and  limited  to  rural  propagation  effects. 

The  JTRS-RR  is  intended  to  enhance  situational  awareness  at  the  Squad  level. 
According  to  General  Martin  Dempsey,  Chairman  of  the  Joint  Chiefs  of  Staff,  “In 
assessing  our  ability  to  overmatch,  we  traditionally  view  the  force  from  the  top- 
down.  However,  as  we  build  Army  2020,  we  will  begin  by  looking  at  the  force  from 
the  bottom-up  with  the  Squad  as  the  foundation.”  SLAD  is  particularly  interested 
in  how  JTRS  radios  and  radio-supported  mobile  ad-hoc  networks  function,  operate, 
and  support  Warfighters  in  both  urban  and  rural  environments,  especially  with 
regard  to  SLV  issues. 
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2.  Purpose 


Our  purpose  is  to  document  V&V  of  the  Sage  2.0  rural  propagation  prediction 
features  and  to  establish  confidence  and  usage  bounds.  These  boundaries  are 
defined  by  the  intended  use  and  the  constraints,  limitations,  and  assumptions 
(CLAs). 

3.  Objective 

The  objective  is  to  use  a  verified  and  validated  model  for  evaluating  SLAD  SLV 
issues  that  require  models  of  rural  propagation  effects.  V&V  is  bounded  by  the 
conditions  described  in  this  report. 

4.  Intended  Use 


The  intended  use  of  Sage  2.0  is  to  provide  SLAD  analysts  and  their  customers  a 
tool  for  pretest  planning  and  in-test  analyses  with  quick  turnaround  of  results. 

Although  Sage  2.0  has  many  useful  features  that  do  not  require  validation  for  test 
planning  purposes,  the  only  validated  use  established  in  this  report  is  the  prediction 
of  link  quality  between  radios  in  both  benign  and  jammer  scenarios.  In  this 
validated  usage,  SLAD  analysts  can  optimize  relative  jammer  and  radio  placements 
in  a  rural  terrain  to  analyze  jammer  effects  on  link  quality.  SLAD  analysts  can  also 
play  back  GPS  coordinates  of  radio  users  from  an  actual  test  event  and  analyze 
radio  performance  as  a  function  of  link  quality. 

5.  Scope 

For  the  purposes  of  this  V&V  activity,  link  quality  refers  to  the  signal-to-noise  ratio 
(SNR)  of  the  link  between  JTRS  Rifleman  and  Manpack  Radios  in  both  benign  and 
jamming  scenarios.  These  2  scenarios  are  described  as  follows: 

1)  Baseline,  benign  case  (no  jamming):  In  this  case,  we  are  interested  in  the 
SNR  of  the  link  between  different  radio  pairings.  The  radios  may  be  all 
possible  combinations  of  RR  and  Manpack  at  both  transmitter  and  receiver. 
The  link  quality  for  each  propagation  direction  between  radios  is  calculated, 
and  is  never  assumed  to  be  symmetrical  in  both  directions.  The  signal  part 
of  SNR  is  derived  from  transmitter  power,  transmitter  antenna  gain,  path 
loss,  and  receiver  antenna  gain.  Transmitter  power,  transmitter  antenna 
gain,  and  receiver  antenna  gain  are  derived  from  RR  and  Manpack 
specifications  (see  Tables  6-8,  Section  11).  Path  loss,  the  loss  between  2 


Approved  for  public  release;  distribution  unlimited. 


2 


radio  nodes,  is  predicted  using  the  Terrain  Integrated  Rough  Earth  Model 
(TIREM)  in  Sage.  In  addition  to  path  loss,  we  verify  the  proper 
implementation  of  both  noise  sources  internally  generated  in  the  radio 
receiver  and  ambient  radio  frequency  noise  external  to  the  receiver. 

2)  Jamming  case:  Jamming  is  restricted  to  barrage  jamming  only,  and  the 
noise  from  the  jammer  is  added  to  the  noise  described  in  the  baseline  case. 
The  amount  of  jamming  noise  power  at  the  radio  receiver  is  derived  from 
jammer  power,  jammer  antenna  gain,  path  loss,  and  receiver  antenna  gain. 
In  addition  to  the  path  loss  between  2  radios,  the  path  loss  between 
jammer(s)  and  the  radio  receiver  is  also  computed.  The  jammer  noise  is 
added  to  the  noise  calculated  in  the  baseline  case. 

6.  Constraints,  Limitations,  and  Assumptions 

CLAs  are  an  important  tool  for  communicating  and  establishing  the  bounds  of  the 
V&V.  For  this  V&V,  we  used  the  Military  Operational  Research  Society’s 
definitions2  of  CLAs: 

•  Constraint:  A  restriction  imposed  by  the  study  sponsor  that  limits  the  study 
team’s  options  in  conducting  the  study. 

•  Limitation:  An  inability  of  the  study  team  to  fully  meet  the  experiment 
objectives  or  fully  investigate  the  experiment  issues. 

•  Assumption:  1)  An  educated  supposition  in  an  experiment  to  replace  facts 
that  are  not  in  evidence  but  are  important  to  the  successful  completion  of  a 
study  (contrasted  to  presumption).  2)  Statement  related  to  the  study  that  is 
taken  as  true  in  the  absence  of  facts,  often  to  accommodate  a  limitation 
(inclusive  of  presumptions). 

6.1  Constraints 

This  V&V  activity  was  constrained  to  be  completed  in  6  months.  The  S4  program 
is  following  an  iterative  V&V  process,  so  future  model  releases  will  also  be  V&V’d 
as  they  are  developed.  Also,  features  within  Sage  2.0  that  are  not  V&V’d  at  this 
point  in  time  will  be  V&V’d  as  time  and  resource  constraints  allow. 

6.2  Limitations 

The  Sage  2.0  model  met  our  objectives  with  one  limitation.  This  limitation  is  that 
we  did  not  observe  sufficiently  close  agreement  when  using  the  US  Military 
Specification  Digital  Terrain  Elevation  Data  (DTED),  MIL-PRF-89020B,3 
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standard  from  National  Geospatial-Intelligence  Agency  2  terrain  data,  when  it  was 
compared  to  results  using  DTED  Level  1  terrain  data.  (Level  1  data  has  a  post 
spacing  of  approximately  90  m;  Level  2  data  has  a  post  spacing  of  approximately 
30  m).  Because  we  were  not  able  to  satisfactorily  explain  the  reasons  for  the 
differences,  we  cannot  claim  validity  against  all  terrain  resolution  types.  For  this 
activity,  we  are  limited  to  V&V  only  for  DTED  Level  1  terrain  data.  This  issue  is 
discussed  further  in  Section  8,  in  the  subsections  “Propagation  Regression  Testing 
Using  DTED  Level  1  Terrain”  and  “Propagation  Regression  Testing  Using  DTED 
Level  2  Terrain”,  and  in  Section  9,  in  the  subsection  “Sage  Path  Loss”. 

Limitations  should  not  be  confused  with  error  sources  in  the  submodels  used  in 
Sage,  such  as  TIREM.  These  error  sources  are  described  in  Section  11,  “Validation 
and  Error  Bounds  of  TIREM  and  Data  Sources.” 

6.3  Assumptions 

The  primary  model  used  in  computing  path  loss  in  Sage  2.0  is  TIREM.  We  assume 
that  TIREM  is  valid  within  known  error  bounds  for  the  terrain  types  that  SLAD 
analysts  encounter  when  Sage  2.0  is  used  to  support  a  particular  test  event  or  study 
activity. 

7.  Synopsis  of  V&V  Methodology 

Both  verification  and  validation  depend  on  the  perspective  of  intended  use. 
Simplified  definitions  follow: 

•  Verification:  The  process  of  determining  that  a  model  or  simulation 
implementation  and  its  associated  data  accurately  represent  the  developer’s 
conceptual  description  and  specifications.  Verification  is  aimed  at 
answering  the  question,  “Did  I  build  the  thing  right ?”. 

•  Validation:  The  process  of  determining  the  degree  to  which  a  model  or 
simulation  and  its  associated  data  are  an  accurate  representation  of  the  real 
world  from  the  perspective  of  the  intended  uses  of  the  model.  Verification 
is  aimed  at  answering  the  question,  “Did  I  build  the  right  thingT'. 

The  governing  V&V  process  and  methodology  used  for  this  activity  were  based  on 
the  SLAD  report,  “Verification  and  Validation  (V&V)  Methodology  for  the  System 
of  Systems  Survivability  Simulation  (S4),”  which  was  intended  to  be  general 
enough  to  support  a  wide  range  of  V&V  activities.4  It  is  outside  the  scope  of  this 
report  to  reconstruct  the  V&V  methodology  in  its  entirety,  but  it  is  useful  to  revisit 
the  underlying  concepts. 
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In  every  model  development,  choices  regarding  fidelity  and  technical  focus  areas 
involve  human  judgment.  In  the  case  of  S4,  these  choices  are  typically  made  by 
analysts  with  SLAD  SLV  expertise.  In  addition  to  bringing  the  right  technical 
knowledge  to  bear,  this  also  helps  ensure  that  the  modeling  choices  are  made  based 
upon  the  objectives  of  the  analysts  who  will  ultimately  be  using  the  model.  The 
process  followed  in  the  S4  project  is  the  creation  of  domain  model  specifications 
(DMS)  by  SLAD  SLV  experts.  The  DMS  describe  the  models  that  need  to  be 
developed,  or  select  an  existing  model  and  describe  the  necessary  interfaces  to  that 
model.  The  overall  validity  of  Sage  2.0  for  meeting  its  experimental  objectives  is 
detennined  by  the  sufficiency  of  this  process  and  the  expertise  of  the  subject  matter 
experts  who  create  the  DMS. 

In  addition  to  the  overall  validity  of  Sage  2.0  as  developed  by  the  SLAD  SLV 
experts,  we  are  also  interested  in  the  validity  of  the  submodels  used  in  Sage  2.0. 
For  this  V&V  activity,  we  are  especially  interested  in  the  validity  of  TIREM  for 
path  loss,  and  the  validity  of  the  data  used  to  compute  SNR. 

The  DMS,  in  turn,  are  used  by  software  developers  to  create  software  model 
specifications  (SMS)  that  translate  the  DMS  into  tenninology  that  can  be  turned 
into  software  code.  A  critical  next  step  is  a  review  involving  both  domain-level 
experts  and  software  experts,  to  ensure  that  the  SMS  meet  the  intent  of  the  DMS. 

After  the  software  code  is  developed,  each  software  requirement  is  tested  in  a  unit 
test.  SMS  incorporate  2  methods  for  programmatic  verification  of  requirements: 
unit  tests  and  sim-health  reports.  All  nontrivial  requirements  have  one  or  more  of 
such  verification  tests.  These  tests  are  employed  throughout  the  development  cycle, 
as  well  as  used  for  verifying  the  final  release  of  the  product. 

Unit  tests  are  used  to  test  model  implementations  in  isolation,  from  other  models 
as  well  as  from  specific  scenarios.  They  are  used  for  verification  in  the  V&V 
process  and  for  regression  testing.  These  regression  tests  are  not  only  used  within 
the  development  cycle  but  may  live  well  past  the  life  of  the  major  release. 

Sim-health  reports  take  data  from  a  set  of  simulation  runs  and  inspect  that  data  to 
ensure  that  the  models  obey  various  constraints.  In  the  context  of  verification, 
constraints  specified  in  the  software  requirements  are  compared  to  what  is  observed 
in  the  run-set.  If  the  sim-health  report  passes,  it  means  that  for  all  runs,  the  models 
obeyed  the  tested  constraints.  If  the  models  exceed  the  constraints,  the  report  fails 
and  those  instances  are  identified. 

Unit  tests  and  sim-health  reports  are  covered  in  Section  8,  “Unit  Level  Verification 
Tests  for  Path  Loss,  Link  Quality,  and  Noise.” 
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After  unit  test  and  sim-health  reports  are  completed,  the  SLV  analyst  runs 
simulation-level  tests  to  verify  that  the  simulation  is  perfonning  as  intended.  For 
this  V&V  activity,  these  higher  level  tests  were  fairly  simple  and  straightforward, 
and  the  analysts  were  able  to  check  simulation  results  against  standalone  models 
and  spreadsheets.  Simulation-level  tests  are  covered  in  Section  10,  “Verification  of 
Sage  2.0  Path  Loss  and  SNR  at  the  Simulation  Level.” 

The  final  step  in  the  verification  process  is  to  trace  from  tests  to  SMS  to  DMS  to 
ensure  that  all  domain  requirements  are  addressed. 

8.  Unit-Level  Verification  Tests  for  Path  Loss,  Link  Quality,  and 
Noise 


The  following  4  unit  tests  provide  results  and  details  for  each  testing  area,  as  well 
as  important  references. 

8.1  Propagation  Regression  Testing  Using  DTED  Level  1  Terrain 

This  test  is  based  on  a  large  set  of  coordinates  that  were  run  in  a  standalone  TIREM 
and  compared  to  the  same  coordinates/terrain  in  Sage  2.0. 5  The  test  passed  with  all 
links,  no  recalculations,  and  no  duplications,  because  the  values  of  standard 
deviation  and  mean  are  within  the  limits  defined  by  the  domain  expert.  The 
differences  between  the  standalone  model  and  the  Sage  model  are  standard 
deviation:  0.7  dB;  mean:  0.006  dB. 

8.2  Propagation  Regression  Testing  Using  DTED  Level  2  Terrain 

This  test  is  based  on  a  large  set  of  coordinates  that  were  run  in  Sage  2.0  using  DTED 
2  terrain,  and  compared  to  the  same  coordinates,  but  using  DTED  1  terrain,  in  the 
standalone  TIREM.5  The  test  failed,  because  the  values  of  standard  deviation  and 
mean  were  not  within  the  limits  defined  by  the  domain  expert.  We  expected  the  test 
to  fail  in  standard  deviation,  because  the  DTED  Level  2  is  higher  resolution  and 
one  would  expect  different  TIREM  results.  However,  we  were  surprised  to  find  that 
the  test  failed  in  the  comparison  of  mean  values.  The  differences  between  the 
standalone  model  and  the  Sage  model  are  standard  deviation:  6.0  dB;  mean:  7.3  dB. 

Upon  examination  of  the  DTED  Level  2  terrain  data,  we  discovered  several 
dropouts  where  terrain  data  was  nonexistent.  Upon  visual  examination,  the  terrain 
also  contained  odd  patterns.  However,  the  reason  that  this  set  of  data  produced  such 
a  large  difference  in  mean  values  has  not  yet  been  fully  run  to  ground.  It  has  not 
been  adequately  proven  that  the  fault  lies  with  the  DTED  Level  2  data.  It  could  also 
be  that  the  DTED  Level  1  data  is  producing  the  errors.  However,  we  chose  to  use 
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the  DTED  Level  1  terrain  data  for  Sage  2.0  at  this  time  because  the  combination  of 
DTED  Level  1  terrain  data  with  TIREM  has  been  used  in  another  V&V’d  model, 
the  Network  Connectivity  Analysis  Model  (NCAM).6  The  last  possibility  is  that 
TIREM  simply  produces  different  results  for  different  terrain  resolutions,  which 
can  only  ultimately  be  resolved  through  comparison  of  Sage  2.0  with  actual 
TIREM-measured  validation  data. 

8.3  Link  Quality  Tests 

The  data  is  found  in  reference  5.  All  metrics  calculations  in  the  unit  test  are  within 
0.001,  the  criteria  for  passing.  Table  1  shows  an  excerpt  from  Harikumar’s  source 
spreadsheet.5 


Table  1  An  excerpt  from  20130412-RuralProp-Jammer-with  Cmp.xlsx 


(Tx-Rx) 

TIREM 

Prop 

Loss 

(dB) 

Receive 

Signal 

Power 

TIREMProp 
Loss  (Tx  to 
Rx  Link) 
dBm 

Receive 

Noise 

Power- 

TIREM 

(dBm) 

5NR3 

(Receive 

Signal 

Power 

TIREM  - 

Noise 

Power) 

(dB) 

SAGE-LQ- 

Path  Loss 

(dB) 

•  ’A- 

Rec 

power 

(dBm) 

SAGF-IQ- 

total 

noise 

power 

(dBm) 

SAGE-LQ- 

SNR 

Dlff  PathLoss 

Diff  Rec 

Power 

Diff  Noise 

Power 

Diff  SNR 

163.6 

-122.6103 

-58.5859009 

-64.0244 

163.5563 

-122.567 

-58.5861 

-63.9805 

-0.04373665 

0.043736654 

-0.00018692 

0.04392357 

169.7 

-128.7103 

-70.0846709 

-58.62563 

169.7344 

-128.745 

-70.1282 

-58.6166 

0.034443635 

-0.034443635 

-0.04348192 

0.00903828 

165 

-119.9897 

-70.5845094 

-49.40519 

164.9731 

-119.963 

-70.5944 

-49.3683 

-0.02692999 

0.026929993 

-0.00991555 

0.03684554 

160.4 

-115.3897 

-72.0845155 

-43.30518 

160.3739 

-115.364 

-72.0652 

-43.2984 

-0.02613932 

0.026139324 

0.019318474 

0.00682085 

159.5 

-114.4897 

-67.6854575 

-46.80424 

159.5301 

-114.52 

-67.7226 

-46.7972 

0.030098319 

-0.030098319 

-0.03711379 

0.00701547 

145.5 

-114.5309 

-71.684844 

-42.84606 

145.4479 

-114.479 

-71.7036 

-42.7752 

-0.05213838 

0.052138379 

-0.01870822 

0.0708466 

163.3 

-132.3309 

-82.0650626 

-50.26584 

163.3499 

-132.381 

-82.0899 

-50.2909 

0.049878667 

-0.049878667 

-0.02483928 

-0.02503938 

157.8 

-126.8309 

-78.0809744 

-48.74993 

157.7736 

-126.804 

-78.0557 

-48.7488 

-0.02642223 

0.026422229 

0.025305278 

0.00111695 

155.2 

-124.2309 

-89.1772496 

-35.05365 

155.1691 

-124.2 

-89.2373 

-34.9628 

-0.03085765 

0.030857653 

-0.06001311 

0.09087076 

151.6 

-120.6309 

-90. 1052844 

-30.52562 

151.6304 

-120.661 

-90.087 

-30.5742 

0.030361892 

-0.030361892 

0.018247419 

-0.04860931 

145.5 

-114.5309 

-84.3505065 

-30.18039 

145.5106 

-114.542 

-84.3678 

-30.1738 

0.010647063 

-0.010647063 

-0.01725627 

0.00660921 

149.6 

-118.6309 

-86.9405168 

-31.69038 

149.6249 

-118.656 

-86.912 

-31.7438 

0.024909109 

-0.024909109 

0.028533374 

-0.05344248 

147 

-99.9897 

-77.0813189 

-22.90838 

146.9896 

-99.9793 

-77.0373 

-22.942 

-0.01039034 

0.010390339 

0.044023101 

-0.03363276 

144 

-96.9897 

-80.2721537 

-16.71755 

143.9822 

-96.9719 

-80.3159 

-16.6559 

-0.01783392 

0.017833918 

-0.04378353 

0.06161745 
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8.4  Noise  Unit  Tests 


The  tests  passed  as  follows: 

1)  For  the  noise  model  test,  there  are  2  asserts  for  each  link.  One  checks  the 
nonjammer  (environmental)  noise  in  the  spreadsheet  against  what  is 
computed  by  the  model,  and  the  difference  was  within  0.001  dB. 

2)  The  other  assert  checks  that  the  total  noise  power  from  the  spreadsheet 
(based  on  TIREM  propagation)  agrees  to  that  computed  by  the  noise  model 
to  within  0.1  dB. 

9.  Description  of  Sage  TIREM  Implementation  and  Simulation- 
Level  Tests 


The  following  checks  were  made  at  the  Sage  simulation  level: 

•  Requirements  specified  in  the  domain  document  were  checked  for  content. 

•  CLAs  were  reviewed. 

•  Software  specifications  developed  from  the  domain  model  requirements 
were  verified  for  consistency  with  the  domain  specifications. 

•  Results  from  unit  tests  matched  expected  results  in  standalone  calculations 
and  spreadsheets. 

•  Standalone  TIREM  was  compared  to  Sage  TIREM. 

9.1  TIREM  Description  and  History 

TIREM  is  a  rough  earth  model.  This  class  of  model  considers  the  effects  of  the 
irregular  terrain  (elevation  profile)  along  the  propagation  path  and  in  the  vicinity  of 
the  antennas.  Many  of  the  concepts  and  algorithms  employed  in  TIREM  were  based 
on  work  done  at  the  Central  Radio  Propagation  Laboratory  of  the  National  Bureau 
of  Standards  by  Rice,  Longley  et  al.  in  the  late  1960s.7 

The  Electromagnetic  Compatibility  Analysis  Center  (ECAC)  was  the  originator  of 
TIREM8  in  a  computerized  model  form,  beginning  to  achieve  reasonable  maturity 
as  a  Fortran  program  in  the  early  1980s.  Many  of  the  initial  efforts  were  focused  on 
making  the  code  more  compact  and  faster;  these  issues  have  since  been  largely 
overcome  by  great  improvements  in  processor  speeds  and  memory  size. 

SLAD  participated  in  an  in-depth  measurement  program  to  compare  TIREM  with 
measured  data.  The  region  around  Flagstaff,  Arizona,  was  chosen  because  it  offered 
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a  suitable  variety  of  terrain.  SLAD  was  interested  to  see  whether  bandwidth  makes 
a  difference  in  propagation.  To  do  the  experiment,  SLAD  transmitted  narrowband 
and  wideband  radio  wavefonns,  and  varied  the  location  of  the  transmitter  relative 
to  a  calibrated  receiver.  In  short,  bandwidth  did  not  make  a  significant  difference 
in  propagation.  Many  cubic  meters  of  9-track  tapes  were  accumulated  and 
processed.  The  resultant  SLAD  data  enabled  ECAC  to  modify  TIREM  for  DOD 
use  and  eventually  led  to  the  creation  of  a  Java  version  of  TIREM  (via  Alion 
Science  and  Technologies)  to  become  the  de  facto  propagation  tool  for  the  Federal 
Government.  TIREM  is  used  in  hundreds  of  modeling  and  simulation  (M&S)  tools 
and  tactical  Military  radios  for  the  DOD.  This  code  is  the  version  S4  and  NCAM 
are  using.  One  result  of  the  data  analysis  was  that  ECAC  (through  its  contractor 
IITRI)  tweaked  TIREM  slightly  in  the  mid-1980s. 

The  ECAC  became  the  Joint  Spectrum  Center  and  a  new  contractor,  Alion  Science, 
was  used.  Alion  Science  wrote  a  Java  version  of  the  Fortran  code.  This  is  the 
version  used  in  both  S4  and  NCAM. 

9.2  Sage  Screenshots  for  Link  Comparison 

Figure  1  shows  a  screen  capture  from  Global  Mapper  for  a  random  link.  Figure  2 
shows  the  terrain  profile  for  the  link  in  Fig.  1.  These  figures  are  examples  of  a 
typical  terrain  type  and  elevation  profile  from  Sage  used  to  compare  against 
standalone  TIREM. 
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Fig.  1  Screenshot  from  Global  Mapper  showing  a  radio  link  with  parameters: 
350  MHzRef3-L0R7000-L179R6000 


From  Pot  106  07I3S6IOOO,  32  0S43555600 


To  Pot  106  1541139000.  32  035800000C 


Fig.  2  Terrain  profile  that  corresponds  to  the  link  shown  in  Fig.  1 
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Figure  3  shows  a  screenshot  that  resulted  from  running  Sage  against  one  of  the 
tested  links.  For  this  example,  the  path  loss  predicted  using  Sage  was 
142.03  dB,  which  matched  the  standalone  TIREM  prediction. 


Fig.  3  Sage  screenshot  example  that  demonstrates  agreement  between  Sage  path  loss  and 
the  value  produced  by  the  standalone  TIREM.  The  parameters  run  for  this  example  were 
transmitter  position  320317. 64N  latitude  1060813.20W  longitude;  receiver  position 
320336. 73N  latitude  and  1061433. 87W  longitude;  frequency  1380  MHz;  and  elevation  sample 
spacing  46.52  m. 


9.3  Sage  Path  Loss 

Since  TIREM  is  a  validated  model,  V&V  of  path  loss  in  Sage  is  fairly 
straightforward  and  primarily  a  verification  problem. 

TIREM  takes  as  input  various  transmitter  and  receiver  parameters,  environmental 
parameters,  and  a  terrain  profile.  Sage  models  call  and  use  the  following  parameters 
from  TIREM: 

•  Frequency 

•  Polarization 

•  Permittivity 

•  Conductivity 

•  Humidity 
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Refractivity 

Transmitter  and  receiver  antenna  height  above  the  ground 


Sage  was  not  formally  tested  against  a  wide  variety  of  polarization,  permittivity, 
conductivity,  humidity,  and  refractivity  values,  and  the  default  values  in  Sage  are 
recommended.  The  limited  testing  we  did  by  varying  these  values  did  not 
significantly  affect  results.  We  found  that  for  most  of  our  work,  the  terrain  elevation 
profile  is  the  most  important  factor  contributing  to  TIREM  path-loss  calculations 
(outside  of  spherical  spreading,  of  course). 

Standalone  TIREM  is  a  tool  that  is  able  to  load  a  terrain  dataset  in  the  form  of  a 
DTED  file,  and  that  allows  the  user  to  issue  TIREM  queries  across  that  terrain.  The 
V&V  of  Sage’s  propagation  model  was  done  by  issuing  a  common  set  of  queries 
against  the  same  terrain  data  to  both  the  Sage  propagation  model  and  to  standalone 
TIREM,  and  then  comparing  the  output  of  each. 

As  mentioned,  one  of  the  inputs  to  TIREM  is  a  terrain  profile.  The  profile  is  passed 
to  TIREM  in  the  form  of  a  vector  of  terrain  samples,  each  of  which  has  an 
associated  distance  from  the  transmitter  and  an  elevation  (from  sea  level  in  meters). 
The  distance  is  assumed  to  be  “as  the  crow  flies”  at  sea  level.  More  specifically, 
distances  are  measured  from  some  map  coordinate  to  another  as  if  the  entire  globe 
were  featureless,  with  all  surface  elevations  being  at  sea  level.  Elevations  are 
assumed  to  be  relative  to  sea  level. 

Standalone  TIREM  and  the  Sage  TIREM  were  both  loaded  with  a  DTED  1  dataset 
with  spacing  between  terrain  posts  of  exactly  3  arc-seconds,  or  roughly 
100  m.  Terrain  is  bounded  by  latitude  31°,  33°  N  and  longitude  107°,  105°  W. 
TIREM  was  configured  to  generate  terrain  profiles  by  sampling  the  terrain  at 
roughly  1.5 -arc-second  intervals. 

Because  DTED  Level  1  terrain  data  is  fairly  coarse,  and  because  the  1.5-arc-second 
sample  interval  used  by  TIREM  is  close  to  the  3 -arc-second  resolution  of  the  terrain 
data,  a  slight  difference  in  terrain  profile  sample  spacing  can  in  some  cases  yield 
drastically  different  terrain  profiles.  Therefore,  it  was  extremely  important  to 
replicate  the  terrain  profiling  algorithm  used  by  standalone  TIREM  as  closely  as 
possible  in  Sage.  That  algorithm  is  described  as  follows: 

1)  D  =  distance  between  start  and  end  in  meters 

2)  Dgc  =  great  circle  distance  between  the  start  and  end  points  in  arc-seconds 

3)  Nintervais  =  Floor  (Dgc  /  1 .5  arc-seconds) 

4)  Sample  the  terrain  at  d  =  D  *  n/Ni ntervais  where  n  =  [0,  Nintervais] 
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We  concluded  that,  for  reasons  unknown,  in  many  of  these  cases,  the  value  of 
Nintervai  used  by  Sage  for  a  query  (computed  using  the  algorithm  above)  differed 
from  the  value  used  by  standalone  TIREM.  Therefore,  in  cases  where  the  path-loss 
value  computed  by  Sage  differed  from  that  of  TIREM  by  more  than  0.5  dB,  the 
offending  query  was  repeated  by  varying  Nintervais  by  as  much  as  ±3  to  find  a  result 
that  best  matched  TIREM. 

Perfonning  the  search  produced  a  much  closer  match  to  TIREM,  but  some 
anomalies  remained.  It  was  found  that  by  adjusting  one  of  the  peaks  in  the  elevation 
profile  very  slightly  (on  the  order  of  a  few  centimeters),  most  of  the  remaining 
anomalies  were  eliminated. 

9.4  Terrain  Modeling 

For  efficiency  reasons,  the  S4  terrain  model  used  by  Sage  projects  terrain  onto  a 
flat  surface  using  a  geographic  projection.  Using  a  geographic  projection  has  the 
benefit  of  geographic  coordinates  (latitude,  longitude)  being  easily  converted  to  S4 
terrain  model  coordinates  (meters  offset  from  the  southwest  comer)  and  vice-versa. 
A  geographic  projection  is  the  most  convenient,  since  most  widely  available  terrain 
data  uses  it.  To  convert  from  geographic  coordinates  to  S4  coordinates,  all  that  is 
necessary  is  to  multiply  precalculated  lateral  and  longitudinal  meters-per-degree 
factors  by  the  latitude  and  longitude,  respectively.  The  meters-per-degree  factors 
are  calculated  for  the  southwest-most  corner  of  the  terrain  dataset. 

While  this  method  is  sufficient  for  most  purposes,  if  no  considerations  are  made,  it 
can  introduce  several  kinds  of  errors  in  various  terrain  queries.  In  particular,  some 
adjustments  must  be  made  when  querying  terrain  for  the  elevation  profile  between 
2  locations. 

9.5  Distance  Calculation 

Since  the  S4  terrain  model  uses  a  geographic  projection  (cylindrical),  some  errors 
will  result  if  the  model  is  used  directly  to  calculate  distance  between  any  points  that 
are  north  of  the  southern  border  of  the  terrain  dataset.  The  severity  of  the  error 
depends  on  how  distant  the  points  are  from  each  other,  as  well  as  how  far  north  the 
terrain  data  is. 

Therefore,  when  computing  a  terrain  profile  for  the  purpose  of  radio-path-loss 
detennination  in  Sage,  the  distance  between  start  and  end  points  is  calculated 
externally  to  the  S4  terrain  model.  Sage  uses  an  approximation  referred  to  as  tunnel 
distance  and  defined  as  the  distance  of  a  tunnel  bored  through  the  earth  in  a 
perfectly  straight  line  between  2  locations.  Tunnel  distance  can  be  calculated 
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efficiently  and  since  radio-path-loss  queries  performed  in  Sage  typically  span 
distances  of  <1°  (great  circle  distance)  or  about  100,000  m,  the  error  incurred  by 
this  approximation  is  <0.001%  for  such  distances. 

9.6  Shortest  Path 

Because  the  earth  is  an  ellipsoid,  determining  the  shortest  path  between  2  points  is 
nontrivial.  If  we  assume  the  earth  is  spherical,  then  the  shortest  path  lies  on  a  great 
circle  arc  between  the  2  locations.  The  great  circle  arc  is  the  most  commonly  used 
to  define  the  shortest  path  and  is  generally  acceptable  even  though  it  is  not  exact. 

In  practice,  for  distances  of  <1°  (-100,000  m),  the  method  used  to  trace  the  path 
makes  little  difference.  Therefore,  Sage  simply  linearly  interpolates  latitude  and 
longitude  between  the  2  locations.  This  is  equivalent  to  a  straight  line  on  the 
geographic  projection. 

9.7  Terrain  Interpolation 

Terrain  datasets  are  composed  of  a  finite  number  of  roughly  evenly  spaced  samples, 
referred  to  herein  as  terrain  posts.  Therefore,  in  order  for  a  terrain  model  to  support 
terrain  sampling  in  a  continuous  space,  some  method  of  interpolation  must  be  used 
to  fill  in  the  space  between  posts.  The  standard  terrain  model  used  by  Sage  and  S4 
fills  in  these  “spaces”  by  creating  triangles  between  all  posts  and  sampling  points 
on  the  planes  defined  by  those  triangles.  See  Fig.  4. 


Fig.  4  Terrain  posts  and  triangles 

In  contrast,  the  terrain  model  used  by  standalone  TIREM  fills  in  those  spaces  using 
bilinear  interpolation.  Given  the  4  terrain  posts  nearest  the  sample  point,  the  sample 
point’s  elevation  may  be  calculated  as  follows: 

•  ix  (Xsample  —  Xo)/(xi  -  Xo) 

•  iy  =  (ysampie —  yo)/ (y i  -  yo) 
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.  Za  =  Zoo  *  (1.0-ix)  +  zoi  *  ix 

.  Zb  =  zio  *  (1.0-ix) +  zn  *  ix 

•  Zsample  =  Za  *  (1.0-iy)  +  Zb  *  iy 

In  the  following  calculations: 

•  ix  and  iy  are  interpolation  factors. 

•  Xsampie  and  ysampie,  are  the  longitude  and  latitude  of  the  location  being 
sampled. 

•  xo,  xi,  yo,  and  yi,  are  the  bounding  longitudes  and  latitudes  of  the  4  nearest 
terrain  posts  to  the  sample. 

•  zoo,  zoi,  zio,  and  zn  are  the  elevation  values  of  the  4  posts  nearest  to  the 
sample. 

•  Zsample  is  the  resulting  elevation  of  the  sample  point. 

Columns  share  the  same  longitude  and  rows  share  the  same  latitude;  refer  back  to 

Fig.  4. 


10.  Verification  of  Sage  2.0  Path  Loss  and  SNR  at  the  Simulation 
Level 


Figure  5  shows  a  comparison  of  path-loss  values  computed  in  standalone  TIREM 
and  Sage  TIREM.  These  data  values  typically  match  within  0.01  dB.  These  are  the 
best-case  comparisons  because  the  terrain  inputs  for  both  models  are  exactly 
matched  for  these  cases. 
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Fig.  5  Comparison  of  standalone  TIREM  to  Sage  TIREM  for  links  with  matching  terrain 
profdes 
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Figure  6  shows  a  comparison  of  path-loss  values  computed  in  standalone  TIREM 
and  Sage  TIREM  for  cases  when  the  terrain  inputs  for  both  models  are  closely,  but 
not  exactly,  matched.  This  figure  represents  a  small  portion  of  the  70,000+  links 
that  were  evaluated. 

180  -i - 


re 

Q- 


Link  Number 

Fig.  6  Comparison  of  standalone  TIREM  to  Sage  TIREM  for  links  with  nearly  matching 
terrain  profiles  and  anomalous  events  circled 

10.1  Standalone  TIREM  to  Sage  TIREM  Overall  Comparison 

Sage  was  tested  over  72,4 1 7  different  links  over  a  wide  variety  of  ranges  and  terrain 
types  by  comparing  Sage  TIREM  to  standalone  TIREM.  Out  of  those  links,  0.3% 
were  anomalous  (differing  by  more  than  0.5  dB  in  the  comparison).  Three 
conclusions  can  be  reached  from  this  comparison: 

1)  Very  close  agreement  was  observed  between  standalone  TIREM  and  Sage 
TIREM  for  99.7%  of  the  links. 

2)  The  rare  cases  with  anomalies  were  almost  all  accounted  for. 

3)  The  differences  (errors)  in  the  comparisons  are  generally  much  less — a 
couple  of  orders  of  magnitude — than  the  known  predictive  capability  of 
TIREM. 

Table  2  shows  the  statistics  for  all  links,  including  the  total  number  of  observed 
anomalies.  Each  subsequent  table  row  shows  reduction  in  the  number  of  anomalies 
observed  by  shifting  the  terrain  index  to  help  match  the  elevation  terrain  points 
(refer  to  Section  9,  “Sage  Path  Loss,”  for  a  description  of  this  process). 
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Table  2  Summary  of  all  tested  links 


Terrain 

Postspacing 

Sample 

distance 

±n 

division 

recalcs 

StDev  dB 

Mean  dB 

(Sage/stand 

alone 

TIREM) 

Total  links 

Anomalies 

(>0.5) 

DTED 

3  arc  sec 

1.5  arc  sec 

0 

0.684 

0.006 

72,417 

191 

DTED 

3  arc  sec 

1.5  arcsec 

1 

-0.004 

46 

DTED 

3  arc  sec 

1.5  arcsec 

10 

-0.004 

SK ZEE 

18 

10.2  SNR  Comparisons 

SNR  was  calculated  in  Sage  and  compared  to  an  offline  spreadsheet.  In  all  cases, 
the  SNR  difference  in  the  comparison  was  <0.1  dB,  which  verifies  that  we 
computed  SNR  as  intended. 

The  following  excerpts  from  the  test  spreadsheets  are  shown  below.  Several 
columns  in  the  tables  were  hidden  for  clarity.  The  parameters  in  these  hidden 
columns  are  listed  as  follows: 

•  Sender  and  Receiver  ID 

•  Frequency:  275  MHz 

•  Tx  and  Rx  Wavefonn  Type:  Soldier  radio  waveform  (SRW) 

•  Tx  Antenna  Height:  1.5  m 

•  Tx  Antenna  Azimuth:  0 

•  Rx  Antenna  Height:  1 .5  m 

•  Rx  Antenna  Polarization:  Vertical 

•  Receiver  and  Transmitter  Antenna  Type:  Omnidirectional 

•  Ambient  noise  of  approximately  -170  dBmW/Hz 

We  considered  2  cases  for  SNR — with  and  without  jammers.  First,  we  considered 
the  case  without  jammers  (also  referred  to  as  the  baseline  or  benign  case),  shown 
in  Table  3. 
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Table  3 


Spreadsheet  for  case  with  no  jammer 
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135.24SS2S1 
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-64.23 869CB4 

-98259128 
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6.98613152 

7.0349596 

-0.048828066 

3^L17 

32^”6 

1^33 

1.25 

0 

AT 

2 
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-170 

-105.2452596 
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-0.0488 28086 

3“i7 
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» 

AT 

o 
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-170 

-105.2452596 

10002 

135.2488281 

135.2 

-62.23S69CB4 

-96.259128 

-962103 

43.00656872 

898613152 

9.0349596 

-0.0488 2SC66 

32Q317 

1060 B13 

320336 

S7W 

1.25 

2 

AN/PRC- 

2 
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-170 

-105.2452596 
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135.2458281 

135.2 

-66.25929075 

-100279728 

-100.2309 

38  985 96881 

A9655316 

5.01435969 

-0.048828066 

320317 

-64N 
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320336 
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.S7W 

0 

AN/ PRC- 

o 

2734 

- 

-170 

-107.4541359 

10002 

135.2488281 

135.2 

-5B.21S09092 

-92.2385281 

-911897 

49.23601795 

15.2156107 

15.2644388 

-0.0488 28C6E 

3^7 

1D60S13 

320336 

1061433 

5 

0 

AN/ PRC- 

2 

2734 

-170 

-107.4541389 
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135.2488281 

135.2 

-62.23S69CB4 
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-Q04SE 28086 
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320336 

1061433 

.S7W 
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2734 

- 

-170 

-107.4541389 

10002 

135.2488281 

135  2 

-56.21B09CB2 

-90.23 B5 281 

-901897 

5123601795 

17.2156107 

17.2644388 

-0.0488 28 cee 

3^17 

1060513 

320336 

5 

2 

AN/PRC- 

2 

2734 

- 

-170 

-107 .4541389 

10002 

135.2488281 

135.2 

-60.23S69CB4 

-9A259128 

-94.2103 

47.215448(2 

13. 19501 06 

13.2438389 

-0.048828066 

3^17 

3^3 

1D^13 

ir.  •  "fc- 

154 

5 

0 

AN/PRC- 

154 

0 

359.3 

10 

-170 

-105.2452596 

Q1 

61.23824765 

612 

-24.23695353 

-24.2485476 

-24.2103 

B1OCB30573 

80.996712 

81.(249596 

-0038247 636 

3^17 

I0^3 

3^° 

1°^3 

AN/PRC- 

1.25 

0 

AN/ PRC- 

2 

359.3 

10 

-170 

-105.2452596 

Q1 

61  23824765 

612 

-28.25755375 

-28.2691475 

-282309 

7698770581 

76.976112 

77.0143597 

-0  038247646 

More  details  of  the  step-wise  verification  between  values  obtained  using  standalone 
TIREM  and  Sage  TIREM  are  shown  in  Table  4. 

Table  4  Further  details  describing  case  with  no  jammer 


Sage-LQ- 
path  loss 
(dB) 

Sage-LQ- 

received 

power 

(dBm) 

Sage-LQ- 

total 

noise 

power 

(dBm) 

Sage-LQ- 

SNR 

Diff 

PathLoss 

Diff 

Re  ceived 

Power 

Diff  Noise 

Power 

Diff  SNR 

1B5.2488 

-98.25913 

-105.245 

6.986132 

0.04882809 

-4.069428 

-4.0923E-08 

-0.048828046 

135.2488 

-102.2797 

-105.245 

2.965532 

0.04882809 

5.97177183 

-4.0923E-08 

-0.048828046 

135.2488 

-96.25913 

-105.245 

8.986132 

0.04882809 

-4.069428 

-4.0923E-08 

-0.048828046 

135.2488 

-100.2797 

-105.245 

4.965532 

0.04882809 

7.99237174 

-4.0923E-08 

-0.048828046 

135.2488 

-92.23853 

-107.454 

15.21561 

0.04882809 

-4.069428 

-2.8201E-08 

-0.048828058 

135.2488 

-96.25913 

-107.454 

11.19501 

0.04882809 

5.97177183 

-2.8201E-08 

-0.048828058 

135.2488 

-90.23853 

-107.454 

17.21561 

0.04882809 

-4.069428 

-2.8201E-08 

-0.048828058 

135.2488 

-94.25913 

-107.454 

13.19501 

0.04882809 

69.9617524 

-2.8201E-08 

-0.048828058 

61.23825 

-24.24855 

-105.245 

80.99671 

0.03824765 

-4.05884756 

-4.0923E-08 

-0.038247605 

61.23825 

-28.26915 

-105.245 

76.97611 

0.03824765 

5.98235227 

-4.0923E-08 

-0.038247605 

Next,  we  considered  the  jammer  case.  As  with  the  no  jammer  case,  we  assumed  the 
following: 
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•  Vertical  polarization  for  the  transmitter,  jammer,  and  receiver  antennas. 

•  1.5-m  antenna  length  for  transmitter  and  receiver  antennas,  and 
7.5-m  antenna  length  for  jammer  antenna. 

•  Omnidirectional  antennas  for  transmitter,  jammer,  and  receiver. 

•  1.25-4  W  of  transmitter  power  into  antenna  compared  to  252  W  of  jammer 
power  into  antenna. 

•  Approximately -170  dBmW/Hz  of  ambient  noise. 

Table  5  shows  the  SNR  comparison  between  the  spreadsheet  and  the  Sage  value. 


Table  5  Spreadsheet  for  the  jammer  case 


TX-ID 

fcc-ID 

fnc- 

Rx) 

Tl  RET.' 

Prop 

Loss 

(dB) 

Receive 

Signal 

Power 

TIREM 

Prop  LOSS 
(TXtO  Rx 
Link)  dBm 

Receive 

Noise 

Power - 

THEM 

(dBm) 

SNR3 

(Receive 

Signal 

Power 

TIREM - 

Noise 

Power) 

(dB) 

5AGE-LQ- 

Path  Loss 
(dB) 

SAGE-LQ- 

Rec 

power 

(dBm) 

5AGE-LQ- 

total 

noise 

power 

(dBm) 

SAGE-LQ- 

SNR 

Dlff  Path  Loss 

Dlff  Rec 

Power 

Dlff  Noise 

Power 

Dlff  SNR 

U7R35000 

L348R3000 

163.5 

-122.6103 

-55.52-3009 

-64.0244 

1::  555Z 

-122.567 

-58  5861 

-63.9SC6 

-0.04373665 

0.043736654 

-0.0C0 18692 

0.0439 2®  7 

U7R35000 

L348R4000 

169.7 

-128.7103 

-70.0515709 

-58.62563 

169.7344 

-128.745 

-70.1282 

-58.6166 

0034443635 

-0.034443635 

-0.04348192 

0.009032ES 

L17R32000 

L348R5000 

-1195897 

-70.5315091 

-49.40519 

164.9731 

-119.963 

-705944 

-49.36® 

-0.02692999 

0.025929993 

-0.0GB91555 

0.03684554 

L17R32000 

L348R5000 

160.4 

-1153897 

-72. '3515 155 

-43.30518 

160.3739 

-115.364 

-7213652 

-45  :?5U 

-0.02613932 

0.026139324 

0.019318474 

0.006S2CB5 

U7R330O0 

L348R7000 

-1144897 

-57.524575 

-46.80424 

159.5301 

-114.52 

-67.7226 

-46.7972 

Q 0300983 19 

-0.030098319 

-0.03711379 

0.00701547 

L17R33000 

L34SR8000 

145.5 

-1145309 

-71.684514 

-42.81606 

145.4479 

-114. 479 

-71.7036 

-42.7752 

-0.05Z13838 

0.052138379 

-0.01870822 

0.07CB466 

L17R320OO 

U345R 11000 

163.3 

-1323309 

-32. ‘02*3526 

-50.26584 

163.3499 

-132.381 

-82.0899 

-50.2900 

Q 049878667 

-0.049878667 

-0.03183928 

-0.02503935 

L17R32000 

L34SR 12000 

157.8 

-1263309 

-  75.3309744 

-48.74993 

157.7736 

-126.804 

-78J0557 

-48.74® 

-0.02542223 

0.026422229 

0.025305278 

0.0011195 

Q7R33000 

L34SR130CD 

155.2 

-124.2309 

-59.1772495 

-35.CB365 

155  1591 

-124.2 

5? 15-5 

-34.962B 

-0.03085765 

0.030857653 

-0.06001311 

0.09087076 

L17R33000 

L345R 14000 

151.5 

-120.6309 

-90.122344 

-30.52562 

151.6304 

-120.661 

-90.087 

-30.5742 

Q 03036 1892 

-0.0X361892 

0.018247419 

-0.04550931 

L17R35OO0 

L30SR150CD 

145.5 

-1145309 

-34.3505*365 

-30.18039 

145.5106 

-114.542 

-845678 

-30.17® 

Q 010647063 

-0.010647063 

-0.01725627 

0. '00660921 

L17R35000 

L345R 15000 

149.5 

-118.6309 

-35. 9405153 

-31.69038 

14?  5 14? 

115  555 

-56.912 

-31.74® 

Q 024909109 

-0.031909109 

0.028533374 

-0.05344245 

L17R32000 

L34SR 17000 

147 

-999897 

-77.0513159 

-22.90838 

145 

-9?  ?-?5 

-770373 

15  ?45 

-0.01039034 

0.010390339 

0.044023101 

-0.03363276 

L17R32000 

L345R 15000 

144 

-969897 

-30.2721537 

-16.71755 

14Z  3521 

95  9719 

-803159 

- 16. 6559 

-0.01783392 

0.017833918 

-0.04378353 

0.06161315 

11.  Validation  and  Error  Bounds  of  TIREM  and  Data  Sources 


The  user  must  understand  the  errors  inherent  in  the  predictive  capability  of  Sage 
2.0  that  are  derived  from  the  limitations  of  TIREM  and  the  data  sources,  so  that  the 
conclusions  reached  from  use  of  the  model  do  not  exceed  the  capability  of  the 
model. 
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11.1  TIREM  V&V  and  Expected  Accuracy 


TIREM  is  a  widely  accepted  and  used  industry  standard  in  the  US  Army.  Although 
there  is  not  a  single  document  summarizing  TIREM  V&V,  there  have  been 
extensive  measurements  comparing  TIREM  predictions  to  real-world  path  loss. 

The  bottom  line  (gross  approximation)  is  that  the  mean  value  of  a  large  set  of  path 
losses  is  accurate  within  about  1.5  dB,  with  a  standard  deviation  of  about  10  dB. 
We  accept  the  validity  of  TIREM  within  the  fairly  well-known  error  bounds.  There 
is  some  ongoing  debate  about  the  use  of  TIREM  accuracy  with  different  resolution 
terrain  data.  Currently,  DTED  Level  1  terrain  data  for  White  Sands  Missile  Range, 
New  Mexico’s  Network  Integration  Evaluation  test  area  is  the  accepted  approach. 

This  has  important  implications  for  the  SLAD  analyst  using  Sage  2.0.  Over  a 
statistically  significant  set  of  data,  the  analyst  can  expect  the  mean  value  of  the  set 
of  link  quality  predictions  to  be  very  accurate  (1.5  dB  in  field  conditions  is  difficult 
to  measure  accurately).  On  the  other  hand,  the  analyst  should  guard  against  making 
conclusions  on  individual  links,  as  it  is  not  uncommon  for  individual  links  to  be  in 
error  by  10  dB  (i.e.,  one  standard  deviation  of  error  for  TIREM),  which  is  almost 
as  much  free  space  loss  as  would  occur  if  the  separation  between  radios  were 
quadrupled. 

11.2  Radio  Data  Sources 

The  following  radio  parameters  are  available  in  Sage  2.0,  but  generally  should  not 
be  changed  from  default  values,  unless  the  user  has  great  confidence  in  the  rationale 
for  making  the  change: 

•  Frequency 

•  Antenna  height 

•  Antenna  gain 

•  Antenna  polarization 

•  Transmit  power 

•  Receiver  noise  figure 

Table  6  lists  the  sources  for  the  values  used  for  radio  parameters. 
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Table  6  List  of  data  sources  for  radio  parameters 


Parameter 

Reference 

Noise  Figure  and 
Antenna  Gain 

SLAD  SME  (Patrick  Honan)  based  on  knowledge  of  the  system  gained 
from  test  results  from  the  SLAD  CEWIS  facility 

Bandwidth  and  Data 

Rate  Information 

ITT,  ELECTRONIC  SYSTEMSSoldierRadio  Waveform  (SRW)  1.1,  Software 
Design  Description  (SDD)  for  the  Waveform  Application  (WFA),  July 

2011 

'  For  Limited  UserTest  Operator  And  Field  Maintenance  Manual 

Including  Repair  Partsand  Special  Tool  Lists  for  Radio  Set  AN/PRC- 
155(v)l,  TM  11-5820-1188-13&P,  Dept,  of  the  Army,  April  2011 

EquipmentSet 

'  JTRS  Handheld,  Manpack,  Small  Form  Fit  (HMS)  System  Development 
and  Demonstration  Phase,  Operator  and  Field  Maintenance  Manual 
Including  Repair  Partsand  Special  Tools  List,  ForProduction  Rifleman 
Radio,  General  Dynamics  C4 Systems,  November  2010 

(physical  layer 
parameters) 

'  Detailed  Test  Plan  for  the  Joint  Tactical  Radio  System  (JTRS)  Handheld, 
Manpack,  and  Small  Form  Fit  (HMS)  AN/PRC-154Rifleman  Radio 
Government  Developmental  Test  (GDT)  2.3,  U.S.  Army  Developmental 
Test  Command,  February  2012 

'  DRAFT  Detailed  Test  Plan  for  the  Joint  Tactical  Radio  System  (JTRS) 
Handheld,  Manpack,  and  Small  Form  Fit  (HMS)  AN/PRC-155  Manpack 
(MP)  Radio  Government  Developmental  Test  (GDT)  2,  U.S.  Army 
Developmental  Test  Command,  February  2012 

Es/No 

"Soldier  Level  Integrated  Communications  Environment  (SUCE), 

MODEM  Subsystem  Specification,"  Rev  2.0,  3/12/2004 

The  JTRS-RR  and  Manpack  radios  are  referred  to  as  3  different  kits: 
1)  AN/PRC- 1 54-UHF-KitA,  Rifleman  Radio  UHF;  2)  AN/PRC- 154-LB AND- 
KitA,  Rifleman  Radio  L-Band;  and  3)  AN/PRC-155-UHF-KitA  Manpack  UHF. 
For  each  kit,  the  antenna  length,  antenna  gain,  noise  figure,  channel  bandwidth, 
data  rate,  output  power,  and  3-dB  bandwidth  were  derived  from  the  sources  in 
Table  6  and  are  listed  in  Table  7. 
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Table  7  Characteristics  of  JTRS-RR  and  Manpack  radio  kits 


Radio  type 

Antenna 

mast 

height  (1) 

Antenna 

gain  (2) 

Noise 

figure 

Channel 

bandwidth 

Data  rate 

Output 
power  (3) 

3  dB 

bandwidth 

(BW_3dB) 

(4) 

Es/No_dB 

(5) 

AN/PRC-154- 

UHF-KitA 

1.5  m 

0  dB 

8  dB 

1.2  MHz 

936  Kbps 

5  watts 

600  KHz 

6.1  dB 

AN/PRC-154- 

LBAND-KitA 

1.5  m 

1  dB 

10  dB 

1.2MHz 

936  Kbps 

5  watts 

600  KHz 

6.1  dB 

AN/PRC-155- 

UHF-KitA 

2.5  m 

2  dB 

7  dB 

1.2  MHz 

936  Kbps 

20  watts 

600  KHz 

6.1  dB 

(1)  Heightas  carried  by  soldier  plus  theantenna  length. 

(2)  Gain  at  0  degrees  azimuth,  plus  insertion  loss,  plus  cable  loss. 

(3)  Power  at  antenna  cable. 

(4)  Given  936  Kbps  data  rate  mode. 

(5)  With  99%  probability  of  decoding  data  packet  correctly. 


The  receiver  sensitivity  computation  for  the  JTRS-RR  and  Manpack  radios  was 
based  on  the  following  data  from  Table  7:  data  rate  mode  of  936  Kbps,  BW_3dB 
of  600  kHz,  and  Es/No_dB  of  6.1  dB.  The  levels  for  Rx  sensitivity,  computed  in 
Table  8,  are  consistent  with  those  measured  by  ARL/SLAD  for  radios  hosting 
SRW. 


Table  8  Computed  Rx  sensitivity  for  JTRS-RR  and  Manpack  radios 


Radio  type 

Implementation 

Noise  figure 

Rx  Sensititivity  =  KT  +  10log_10( BW_3dB) 

degradation 

+  Es/No_dB  +  NF  +  ID 

AN/PRC-154 

Handheld 

Radio  -  SRW 

2dB;  typical  for 
small  form  fit 

9.5  dB  UHF  Band; 
typical  for  small 
form  fit 

-174dBm  +58dB  +  9.5dB+  10.28dB  +2dB 

=  -98.6  dBm 

AN/PRC-155 

Manpack 

Radio  -  SRW 

1.5  dB;  typical 

8.5  dB  UHF  Band; 
typical 

-174dBm  +  58dB  +  6.1dB  +  &5dB  +  1.5dB 

=  -100dBm 

11.3  Noise  Data  Validity 

Whereas  propagation  is  concerned  with  the  transmission  of  a  signal  and  how  the 
wave  is  affected  by  the  intervening  medium,  the  noise  model  is  concerned  with 
reception  of  a  signal  and  those  sources  that  compete  with  the  desired  signal.  We 
model  the  following  radio  noise  sources  in  Sage  2.0: 
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•  Ambient  noise,  consisting  of  a  combination  of  galactic  noise  and  man-made 
noise,  modeled  as  data  input  to  the  simulation. 

•  Receiver  noise  (i.e.,  thermal  noise  and  radio  noise  figure  characteristics), 
modeled  explicitly  at  an  engineering  level  based  on  receiver  characteristics 
such  as  frequency  and  channel  bandwidth. 

•  Jammer  noise,  which  undergoes  path-loss  modifications  depending  on 
jammer  placement  relative  to  radio  receiver. 

The  ambient  noise  model  has  a  large  data  component.  The  sources  for  noise  data 
are  referenced  in  the  domain  model  specification.9  The  validity  of  the  noise  model 
is  largely  attributed  to  the  validity  of  the  data  sources. 

Sage  2.0  uses  noise  data  in  a  tabular  fonnat.  This  provides  SLAD  analysts  the 
flexibility  to  implement  different  noise  data  depending  on  the  environment  being 
simulated.  The  V&V  implication  is  that  this  data  must  come  from  an  authoritative 
source. 

The  ambient  noise  table  is  set  up  with  each  row  of  the  table  having  a  frequency  and 
corresponding  noise  power  density  (power/Hz).  Sage  2.0  linearly  interpolates 
between  frequencies  when  data  for  a  given  frequency  is  not  available  in  the  table. 

Ambient  noise  (in  the  baseline,  nonjamming  case)  is  assumed  to  be  homogeneous 
in  space  and  constant  in  time  throughout  the  scenario.  This  provides  several 
simplifying  advantages,  but  it  limits  the  ability  to  investigate  situational  awareness 
differences  in  regions  of  a  scenario  with  nonhomogeneous  noise  characteristics. 

Noise  produced  by  a  jammer  is  directional  in  nature  because  of  Sage  models 
directional  jamming.  Further,  path  loss  between  jammers  and  radios  is  modeled  in 
TIREM  and  path  loss  varies  with  different  intervening  elevation  profiles. 
Therefore,  with  a  jammer  present,  noise  is  not  homogeneous  throughout  the 
scenario. 

Ambient  noise,  jammer  noise,  and  internal  receiver  noise  are  combined  through  a 
simple  summation.  There  are  more  accurate  ways  to  combine  noise  sources,  but 
this  was  considered  sufficient  by  the  domain  experts,  given  the  accuracy  limitations 
of  TIREM.  Further,  when  jammer  power  dominates  over  other  noise  sources,  the 
method  used  to  combine  noise  sources  tends  to  be  less  significant. 
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12.  Conclusions 


Sage  2.0  is  verified  and  validated  for  link  quality  applications  in  rural  terrain, 
subject  to  the  intended  use,  constraints,  limitations,  and  assumptions  described  in 
this  report. 
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List  of  Symbols,  Abbreviations,  and  Acronyms 


ARL 

US  Army  Research  Laboratory 

CLA 

constraint,  limitation,  and  assumption 

DMS 

domain  model  specifications 

DTED 

US  Military  Specification  Digital  Terrain  Elevation  Data 

ECAC 

Electromagnetic  Compatibility  Analysis  Center 

GPS 

Global  Positioning  System 

JTRS-RR 

Joint  Tactical  Radio  System-Rifleman  Radio 

NCAM 

Network  Connectivity  Analysis  Model 

NMSU 

New  Mexico  State  University 

PSL 

Physical  Science  Laboratory 

RR 

rifleman  radio 

S4 

System  of  Systems  Survivability  Simulation 

SLAD 

Survivability/Lethality  Analysis  Directorate 

SLV 

survivability,  lethality,  and  vulnerability 

SMS 

software  model  specifications 

SNR 

signal-to-noise  ratio 

SRW 

Soldier  radio  wavefonn 

TIREM 

Terrain  Integrated  Rough  Earth  Model 

V&V 

verification  and  validation 
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